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Some Important Distributions 


Some Important Distributions 

Discrete Distributions 

. X Bernoulli(p) 

PMF: 


Px{k) = 


V 


for k = 1 


1 — p for k = 0 


CDF: 


0 for x < 0 

Fx(x) ={ 1 — p for 0 < £ < 1 
1 fori < x 


Moment Generating Function (MGF): 


Characteristic Function: 


Expected Value: 


Variance: 


X Binomial(n,p ) 
PMF: 


Mx{s) = 1 — p + pe s 
(j) X (u) = 1 -p + pe lu 
EX = p 

Var(X) = p( 1 — p) 


n 


Px(k)= fork = 0,1,2, 

Moment Generating Function (MGF): 

M x (s) = (1 -p+pe s ) n 

Characteristic Function: 

4>x M = (1 -p + pe lul ) n 

Expected Value: 

EX = np 


■,n 
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Variance: 


MATLAB: 

. X rs>/ Geometric{p) 

PMF: 


Var(X) = np( 1 — p) 

R = binomd(n,p) 


P x (k) = p(l - p) k 1 for 1,2,3,... 


CDF: 


Fx(x ) = 1 — (1 — p) for a: > 0 
Moment Generating Function (MGF): 

Mx{s) = - _ ^_ p y s for s < - ln(l - p) 

Characteristic Function: 


(,t>x{u) 


p e iu) 

1 — (1 — p)e iul 


Expected Value: 


Variance: 


EX 


1 

P 


Var(X) 


1 -p 


P 


2 


MATLAB: 

• X ~ Pascal{m,p) (Negative Binomial) 
PMF: 


R = geornd(p)+l 


Px(k) = ( ]p m (l — p) k m for k = m, m + l,m + 2,m + 3,... 

\m — 1/ 


Moment Generating Function (MGF): 

M x (s) = 

Characteristic Function: 


pe 


1 — (1 — p)e s 


for s < — log(l — p) 


<t>x(w) = 


pe 


1 — (1 — p)e lu 
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Expected Value: 


Variance: 


EX = 


m 


P 


m(l — p) 
Var(X) = -—- 


MATLAB: 

X ~ Hypergeometric(b, r, k) 

PMF: 


p 


R = nbinrnd(m,p)+l 


Px{x) = 


M 

\xJ \k—x) 

TfT 


for x = max(0, k — r ), max(0, k — r) + 


Expected Value: 


Variance: 


EX = 


kb 


Var(X) = 


MATLAB: 

X rv-/ Poisson(X) 

PMF: 


b + r 

kbr b + r — k 
(b + r) 2 b + r — 1 

R = hygernd(6 + r,b,k) 


Px(k) = 


-x X k 

k\ 


for k = 0,1, 2, • • • 


Moment Generating Function (MGF): 


Characteristic Function: 


Expected Value: 


Variance: 


M x (s) = 

(t>x(v) = e A ( e ^ -1 ) 


EX = X 


Var(X) = X 


MATLAB: 


1,..., min(k,b) 
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R = poissrnd(A) 


Continuous Distributions 

. X r\>/ Exponential (X) 
PDF: 


CDF: 


fx(x) = \e Xx , x > 0 


F x (x) = l-e' Xl 

Moment Generating Function (MGF): 

Mx(s) = ^1 — — j for s < A 

Characteristic Function: 


X > 0 


Expected Value: 


Variance: 


VjJ 


(t>X M = ( 1 - y 


EX = 


A 


MATLAB: 

X rv-/ Laplace(p, b ) 

PDF: 


Var(X) = - 


R = expmd(/r), where /J, = -y. 


/x(®) = ^ ex Pl 


F-/^l 



CDF: 


i eX p 




Moment Generating Function (MGF): 


(?) 


if x < 


1 — i ex p( — ) i{x ^ 


if x < p 
| if x > p 

V 
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M x (s) 


e ^s 

1 — b 2 s 2 


for 


s 



Characteristic Function: 


Expected Value: 


Variance: 


4>x(u) 


e fiiui 

1 + b 2 oo 2 


EX = fi 


Var(X) = 2 b 2 


• X ~ iV(/X,(X 2 ) (Gaussian Distribution) 
PDF: 


/*(*) 



e 2cr 2 


CDF: 


= $ 


X — [L 


Moment Generating Function (MGF): 


Mjf(s) = e /iS+ 2 <j2s2 


Characteristic Function: 


4 > x { w ) = e ^-^ 2 " 2 


Expected Value: 


EX = fi 


Variance: 


Var(X) = (7 2 


MATLAB: 

• X ~ Beta(a , &) 

PDF: 


Z = randn, R = normmd(/i,<7) 


/.yU') 


r(q + 6) /„_!) 
r(o)r(fe) 


(l-a;)' 6 - 1 ', 


for 0 < x < 1 


Moment Generating Function (MGF): 
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Expected Value: 


Variance: 


i~i \tJb a + b + r kl 


EX = 


a 


a + b 


Var(X) 


ab 

(a + b) 2 (a + b + 1) 


MATLAB: 

• X ~ \ 2 (n) (Chi-squared) 
Note: 


R = betarnd(a,&) 



Gamma 


n 1 \ 
2 ’ 2 ) 


PDF: 


fx(x) 


n 

2ir(f) 


-X 2 


Moment Generating Function (MGF): 


for x > 0. 


M x (s) 


(1 - 2s) - ? 


for s < — 
2 


Characteristic Function: 


4>X M 


(1 — 2iui) 2 


Expected Value: 


EX = n 


Variance: 


MATLAB: 

• X ~ T'(n) (The f-Distribution) 
PDF: 


Var(X) = 2 n 
R = chi2rnd(n) 


fx(x) 





n+1 

2 


Moment Generating Function (MGF): 
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undefined 


Expected Value: 


EX = 0 


Variance: 


Var(X) = - for n > 2, oo for 1 < n < 2, undefined 

n — 2 


MATLAB: 

. X r\>/ Gamma(oi, A) 
PDF: 


R = trnd(n) 


fx(x) 


X a x a 1 e Ax 


T(a) 


x > 0 


Moment Generating Function (MGF): 


M x (s) = (l - i) 


for s < A 


Expected Value: 


EX 


a 

A 


Variance: 


VartX) = A 


MATLAB: 


R = gamrnd(a,A) 

• X ~ Erlang(k, A) [= Gamma(k, A)], > 0 is an integer 

PDF: 


/x-(z) = 


Moment Generating Function (MGF): 


A^fc-ig-Az 


a: > 0 


Mx{s) = ^1 — — j for s < A 


Expected Value: 


£X 


A 


Variance: 


otherwise 
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X Uniform(a, b) 

PDF: 


CDF: 


Var(X) = A 


fx(x) = 


b — a 


x G [a, b] 


F x (x) = 


0 

x—a 

b—a 


Moment Generating Function (MGF): 


x < a 
x G [a, b) 

for x > b 


s ± 0 


M x (s) = { s ( b ~ a ) 

1 s = 0 


Characteristic Function: 


Expected Value: 


Variance: 


MATLAB: 


(t>X M 


gicufc _ gicua 

iu(b — a) 


EX 


a + b ) 


Var(X) 


1 

12 


(& — a) 2 


U = rand or R = unifrnd(a,&) 


<— previous 
next —> 
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